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(57) Abstract 



An imaging system comprises an image detection unit (52) and a hlter unit (58). Pixel image signals are passed in parallel from the 
image detection unit (52) to the filter unit (58). Circuit elements within each pixel (56) generate pixel image signal whose amplitude is 
proportional to the logarithm of the image intensity at that pixel. The filter unit C58) carries out a spatial filtering operation and outputs the 
result. 
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IMAGING SYSTEM 



The present invention relates to an imaging system. 



5 tn order for a mammalian eye to be able to observe objects over a wide range of light 
intensity levels, a mammalian retina comprises five general types of neurons 
organised into a two layer system. A first layer, the outer plexiform layer, consists of 
detector, horizontal and bipolar neurons. It has been shown that the detector 
neurons' response is a logarithmic function of the photon fiux. Signals from the 

10 detector neurons are passed to the horizontal neurons which allow the signals to 
spread laterally. The bipolar neurons respond to the differences between the signals 
from the detector and horizontal neurons. The result is a bipolar neuron response 
which is a function of the spatial and temporal changes in the response of the 
detector neurons and the response is relatively insensitive to changes in the overall 

15 illumination level. 

Electronic sensors such as charge coupled device sensors generally operate over a 
limited range of illumination levels. Commercial camera systems often incorporate an 
automatic gain control to alter the operating point depending on the level of 
20 illumination. Where there is a bright light source within a scene, the automatic gain 
control results in the loss of detail in the scene. 



In a natural scene, the light intensity L(x,y) reflected from an object having a 
reflection coefficient R(x,y) under an illumination level l(x,y) is given by the equation: 

25 

L(x,y) = l(x,y)R(x,y). 

Within any scene, the illumination level may typically vary by up to two decades whilst 
the reflectivity might vary by up to one decade, giving a maximum of three decades of 
30 variation in intensity. In order to detect intensity changes at a level of one per cent 
over an intensity range of three decades after digitisation of the sensor output, 
approximately seventeen bits per pixel would be required. In contrast, when the 
image is displayed, for example using a cathode ray tube, a human operator can only 
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distinguish approximately one hundred grey levels, which corresponds to about 
seven bits Large amounts of information are therefore lost. 

A loganthmic detector response D(x,y). is given by the equation. 

5 

D(x, y) = log(R(x. y)) + log( l(x, y)) 

If a spatial average response is subtracted from the detector response, this v/ill have 
the effect of attenuating the conthbution from the l(x,y) term more than that from the 

10 R(x,y) term A retina which attenuates the intensity contribution due to the 
illumination level relative to the contribution due to the reflection coefficient reduces 
the dynamic range required to represent a scene without losing the critical 
information represented by R(x.y). In the case of the mammalian eye. the outer 
piexiform layer converts a large dynamic range input into a smaller dynamic range 

1 5 output. 

Sensors which mimic the behaviour of mammalian retinas are sometimes referred to 
as artificial retinas. Artificial retina structures have been reported previously. An 
artificial retina structure has been described by C.A.Mead in -Analog VLSI and Neural 

20 Systems'. Addison Wesley, 1989 and illustrated by Figure 1. The Mead structure 
suffered from two disadvantages. The structure had a slow response time and sc 
was limited to bnght scenes and mismatch between devices meant that only objects 
with a relatively high contrast could be observed. In addition, the number of oevices 
within each pixel meant that the smallest possible size of 109 by 97 urn was 

25 relatively large, limiting the spatial resolution of the structure. 

K.A.Boahen and A.G.Andreou. in Int. J. Comp. Vision, Volume 8 (1992), pages 76^ 
to 772, proposed a retina with fewer devices per pixel. This retina comprised two 
networks of lateral devices connected within each pixel with a small feedback loop 
30 The Boahen and Andreou retina suffered from the disadvantage that corrections 
required to overcome device variations were illumination dependent. 

United Kingdom Patent Application No. 9204434.6 describes a differential amplifier 
incorporating floating gate devices which are programmable to correct imbalances 
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arising from device mis-match. The devices therein are arranged to operate above a 
device threshold voltage such that the devices are operating in saturation. 

French published patent specification FR-A-2 543 363 describes an analogue 
5 integrated circuit using transistors whose threshold voltage is electrically adjustable, 
tooether with a comparator suitable for controlling the adjustment of the potentials on 
the floating gates of two floating gate devices. The transistors of the analogue circuit 
are arranged to operate above the threshold voltage, where the current in the 
transistor is directly related to the threshold voltage. For a field effect transistor 
10 operating above the threshold voltage, the current through the transistor. In is given 
by the expression; 



15 where P and Vt. the threshold voltage, are device dependent parameters. Adjusting 
the threshold voltage of a floating gate transistor may reduce the effect of this device 
dependent parameter but differences between devices of p still remain. The teaching 
of FR-A-2 543 363 indicate that field effect transistors are not suitable for operation 
below the threshold voltage, referring to two distinct modes, a "blocked mode" (un 

20 mode bloque) and a "conductive mode" (un mode conducteur), the threshold voltage 
separating the two modes. 

Analogue image processing was reviewed by S.Collins and M.Wade in a scientific 
paper presented to an lEE Symposium "Integrated Image Sensors and Processing" 

25 on December 5th 1994. In this paper, the suitability of an imaging system comprising 
a logarithmic detector and a centre-surround receptive field for use as a surveillance 
system was discussed. This paper indicated that such a system would be 
advantageous since a typical scene has an intensity histogram which exhibits a multi- 
modal distribution whereas a processed image would have a uni-modal distribution, 

30 which could be more efficiently encoded as a digital signal. The paper did not 
provide an example of such a system nor any indication as to how one may be 
constructed. The results presented therein were the results of a computer modelling 



exercise 
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It IS an object of the invention to provide an alternative imaging system 

The present invention provides an imaging system comprising detecting means for 
detecting electromagnetic radiation from an :maged scene and for generating pixel 
image signals in response thereto and processing means for filtering spatially the 
pixel image signals and for generating processed image signals having a dynamic 
range which is less than that of the imaged scene, characterized in that the 
processing means is spatially separated from the detecting means. 



Separating the detecting means from the processing means provides the advantage 
that the size of pixels within the detecting means may be reduced compared with the 
Mead arrangement, with consequently greater resolution. 

15 The detecting means may be arranged to generate pixel image signals which have 
magnitudes which are a non-linear function of the image intensity at a particular pixel. 
The non-linear function may be a logarithmic function. 

The spatial filtering may be earned out either digitally after the pixel image signals 
20 have been digitised or using analogue circuitry prior to digitisation. Digital filtenng 
provides the advantage of reducing the amount of dedicated electronic circuitry whilst 
analogue filtenng provides potential benefits in terms of reduced size and power 
consumption compared with digital processing. 

25 The imaging system may include means for correcting non-uniformities in pixel 
element performance. Vanations in pixel elements may, if uncorrected, reduce the 
sensitivity of an imaging system. Correcting pixel non-uniformities may increase the 
sensitivity of an imaging system. 

30 The imaging system of the invention incorporating logarithmic conversion of the 
image may be particularly suited for use as a surveillance system for imaging scenes 
where there is no source of illumination within the scene. For surveillance of scenes 
where there is source of illumination within the scene, a linear detector followed by a 
spatial filter may be beneficial. 



10 
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The imaging system of the invention may form the basts for an electronic 
photographic system where processed images are stored and then later displayed 

5 In order that the invention may be more fully understood, embodiments thereof will 
now be described, by way of example only, with reference to the accompanying 
drawings, in which:- 

Figure 1 shows a prior art imaging system: 

1 0 Figure 2 shows an imaging system of the tnvehtion; 

Figure 3 shows a detector pixel circuit of the Figure 2 system; 

Figure 4 is a schematic diagram of a floating gate MOSFET; 

Figure 5 shows a high voltage routing circuit; 

Figure 6 shows a part of a bar-fiiter unit of the Figure 2 system; 
15 Figure 7 shows a buffer unit of the Figure 6 bar-filter unit; 

Figure 8a shows an averaging unit of the Figure 6 bar-filter unit; 

Figure 8b shows a further averaging unit of the Figure 6 bar-filter unit; 

Figure 9 shows a comparator unit for programming floating gate devices in the 

Figure 8a and 8b averaging units; 
20 Figure 10 shows a biasing unit of the Figure 6 bar-filter unit; 

Figure 1 1 shows a simple transconductance amplifier; 

Figure 12 shows a surveillance system incorporating the Figure 2 imaging 

system; 

Figure 13 shows an alternative imaging system of the invention; 
25 Figure 14 shows a current mode buffer circuit; 

Figure 15 shows a plan of a convolution filter architecture; 

Figure 16 shows a village scene with and without filtering; 

Figure 17 shows a road scene with and without filtering; 

Figure 18 illustrates pixel intensity distributions with and without fittenng; 
30 Figure 19 shows three bits per pixel representations of the Figure 17 images; 

Figure 20 shows a single bit per pixel representation of a Figure 17 image; 

Figure 21 shows a simulated night-time road scene; 

Figure 22 shows the Figure 21 image after logarithmic conversion and spatial 

filtering; and 
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shows the Figure 21 image processed to reauce the effect of dazzle. 



10 



Referring to Figure 1 there is shown a circuit diagram of a single pixel 10 of a prior art 
silicon retina developed by Mead referred to earlier The pixel 10 comprises a 
receptor unit 20, a lateral averaging unit 22 and an output unit 24. The receptor unit 
20 is a logarithmic detector comprising two diode connected p-channei metal oxide 
semiconductor field effect transistors (MOSFETs) 26 and 28 and a p-n-p 
phototransistor 30. An output 32 from the detector unit 20 is connected to both the 
lateral averaging unit 22 and the output unit 24. 



The lateral averaging unit 22 compnses a transconductance amplifier 34. The unit 22 
calculates a local average response using a network of lateral connections 36 to 
adjacent pixels. The amount of current injected into the network within each pixe! 
through the transconductance amplifier 34 is dependent upon the difference between 

1 5 the voltage of the network. Vi^ode and the output voltage of the receptor unit 20. Vp^o.-o- 
thereby creating a weighted local average of the pixel outputs. The averaging 
process is controlled by the conductance of the transconductance amplifier 34 and 
the resistance of MOSFETs in the unit 22. To ensure the conductance of the 
MOSFETs is illumination independent, a second transconductance amplifier 38, 

20 referred to by Mead as a horizontal resistor (HRes) circuit, is included in the unit 22. 
The local average voltage is passed on an output 40 to the output unit 24. 

The output unit 24 is a further transconductance amplifier 42. The amplifier 42 
amplifies the difference between the local average voltage and the receptor unit 
25 voltage, Vp^o.-o. creating a high-pass filtered output of a logarithmic representation of 
the input image with low spatial frequencies removed. 

Biological retinae share at least two common features: detectors whose response is 
proportional to the logarithm of the incident photon fiux and output neurons with 
30 antagonistic centre-surround receptive fields. In an antagonistic centre-surround 
receptive field, the response of an output neuron is proportional to the difference 
between an average of the responses of a small central group of detectors and that 
of a larger surrounding group. The response of the output neurons with this type of 
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receptive field can oe modelled by convolving the logarithm representation of the field 
with a Difference of Gaussian (DoG) filter, [^q^q-, 

5 

in order to represent an antagonistic centre-surround receptive field, both A and S 
must be positive and Cn > Op. Convolving this function with an image in the spatial 
domain is equivalent to multiplying the Fourier transform of the scene by the Fourier 
transform of the convolution kernel fooG- The Founer transform of a Gaussian Is a 

10 low pass filter with a characteristic frequency which is inversely proportional to the 
width parameter, a. Combining two Gaussians in a DoG filter results in a band-pass 
filter This filter removes all the high frequencies. In contrast, the amount of low 
frequency attenuation is determined by the values of A and 8. If A and B are 
normalised so that the output from convolving the filter with a constant scene is zero. 

15 then the lowest frequencies are also removed. However, some low-frequency 
components can be retained if B is smaller than this critical value. Overall the DoG 
filter is a band-pass filter in which the high frequencies are removed and low 
frequencies are either attenuated or removed. 

20 Although a biological retina incorporates band-pass filters, a high-pass filter is all that 
IS required to create the desirable illumination independent output. This type of filter 
may be one which takes the difference between a detector response and a Gaussian- 
weighted local average. This is computationally less expensive than a DoG filter. 

25 Refernng now to Figure 2 there is shown in schematic form an imaging unit 50 of the 
invention. The imaging unit 50 comprises a detector unit 52, having an array 54 of 
detector pixels such as pixel 56. and a bar filter unit 58. The array 54 is square, 
having 512 columns and 512 rows of pixels. Each detector pixel, such as pixel 56. 
has a logarithmic response to incident light. Each pixel generates a voltage in 

30 response to incident light. Each row of pixels has a respective row output 60. The 
pixels within a column are simultaneously read out in parallel to the bar filter unit 58 
via the row outputs 60. Since there are 512 rows of pixels, there are 512 row outputs 
60. 
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The bar filter unit 58 comprises an array of circuit elements such as element 62. The 
unit 58 has fifteen columns and 512 rows of circuit elements. The unit 58 has a 
central column 64 of circuit elements which include respective output devices (net 
5 shown). The circuit elements in the central column 64 are thus modified from the 
circuit elements in the other fourteen columns. The bar filter unit 58 calculates a local 
average response and generates output signals dependent on differences between 
individual detector pixel outputs and the local average response. The output signals 
from circuit elements in the central column 64 are sequentially connected to an 

10 imaging unit output 66. As the voltages from each column of pixels in the detector 
unit 52 are passed to the bar filter unit 58, the unit 58 moves previous pixel voltages, 
stored in each circuit element, one column to the nght. For an imaging unit operating 
at a frame rate of 50 Hz, each column of pixel voltages is processed in approximately 
40 ixs and the total storage time for a particular pixel output in the bar filter unit 58 is 

1 5 fifteen times this figure, or approximately 0.6 ms. 

By separating the detector unit 52 from the bar filter unit 58, the size of the pixels in 
the detector unit 52 may be smaller than the minimum size of pixels in the pnor art 
system of Figure 1 since fewer circuit elements are required. By reducing the pixel 
20 size, a greater resolution is obtainable. 

Referring now to Figure 3 there is shown a detector pixel circuit 100. Each of the 
detector pixel circuits of the Figure 2 detector unit incorporates the detector pixel 
circuit 100. The circuit 100 contains a bipolar phototransistor 102 which converts a 

25 photon flux into a current. The photocurrent from the phototransistor 102 is injected 
into two diode connected n-channel MOSFETs 104 and 106 operating in series which 
convert the photocurrent into an output voltage. A p-channel source follower 
MOSFET 108 provides sufficient drive for the output voltage to be read via a common 
row output line 110. The row output line 110 corresponds to the row output 60 of 

30 Figure 2. Which pixel from a row is connected to an output line is controlled by a 
column select signal on a column select line 

When a column select line 112 is in a logical high' state, a pass transistor 114 is 
conducting and the voltage on the row output line 110 is determined by the output 



I 
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voitage of the pixel circuit 100. For the pixel circuit 100 the logical high" state 
corresponds to 0 volts on the select line 112 and a logical low state corresponds to 
+5 volts on the line 112. The circuit 100 incorporates a p-channel floating gate 
MOSFET 1 16 which acts as a programmable current source. The MOSFET 116 only 
5 acts as a current source when the column select line 112 is at logical high. To 
achieve this, there is a coupling capacitance Cpp between the line 112 and the 
floating gate 118. If the floating gate 118 has a capacitance Cfor. then a change \n 
voltage ^Vseiect causes a change in floating gate potential of CppAV^^f^^r I C^^^ The 
initial floating gate potential and the change in potential when line 112 changes state 
10 must together ensure that the channels of de-selected devices are blocked. 

Referring to Figure 4 also, there is shown in schematic form a diagram of the 
MOSFET 116. Figure 4a shows the MOSFET 116 in plan view and Figure 4b is a 
sectional view of the MOSFET 1 16 along a line IV-IV in Figure 4a. The MOSFET 116 

15 has a source contact 120 and a drain contact 122, each of which contact respective 
implant regions 124 and 126 in a n-type substrate 128. The poiy-silicon floating gate 
118 is surrounded by an oxide region 130. A poiy-silicon control gate 132 with 
contacts 134 overlies the floating gate 118. in order to inject charge onto the floating 
gate 118. a poly-silicon tunnelling injector 136. having a contact 138, overlies a limb 

20 140 of the floating gate 118. Charge is injected onto the floating gate 118 when a 
high voltage is applied to the injector 136 through an electron tunnelling process. 
The ability to alter the charge on the floating gate is required in order to trim the 
operation of the circuit 100 to reduce inter-pixel variations. An injector select line (not 
shown) IS connected to the contact 138 and to contacts of other tunnelling injectors in 

25 the same row as the circuit 100. 

The current-voltage characteristics arising from the tunnelling process mean that if a 
high voltage is applied to all the injectors within a row. the difference in floating gate 
potentials between the selected and de-selected devices must ensure that only the 
30 selected device will be programmed. The coupling of the select signal onto the 
floating gate distinguishes the selected device from the rest of the population. In 
consequence, changing the select signal between its two states should change the 
floating gate potential by at least three volts. If the select signal is either 0 V or 5 V. 





1C 
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then the ratio of the capacitance of the control gate 132 capacitance to the total 
floating gate capacitance is at least 0.6. 

The diode connected MOSFETs 104 and 106 are operated in a sub-threshold 
5 regime. MOSFET device characteristics are descnbed by S.M.Sze in "Physics of 
Semiconductor Devices", John Wiiey & Sons, New York, 1981, pages 431 to 51C, 
where the term sub-threshold is explained. The response of the phototransistor 102 
is tailored, by for example controlling its size, so that the photocurrent generated at a 
maximum operating illumination level is not sufficient to dnve the MOSFETs 104 and 
106 above the sub-threshold regime. It has been found that for a diode-connected 
load MOSFET operating in the sub-threshold regime that the input current, /,., is 
related to the gate-source potential, V, by the equation. 

where lo. k , and Ur are device parameters. G is the gam of the phototransistor 102. 
and Wo is the photon flux at the phototransistor. For an n-channel device in which 
the source is connected to earth, equation (1) may be rearranged to give the 
expression = Ur HI. ' k] I Although the phototransistor 102 ,s connected 
to two diode connected MOSFETs. equation (1) remains generally applicable and the 
output voltage is still a function of the logarithm of the photo-current. 

The source-follower MOSFET 108 is operated ,n saturation such that the device nas 
an output voltage V„„, related to an input voltage V,. by the equation, 



15 



20 



25 



12J_ (2), 



Where / is the source current and W and (3 are device parameters. The floating 
gate MOSFET 116 provides a programmable current source within the pixel for 
30 tnmmmg vanations in both the variations of the parameters of the MOSFET 108. W 
and and variations in V„ such as variations ,n the gam G of the phototransistor 102 
or the device parameters of the MOSFETs 104 and 106. 
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In order to facilitate programming of the MOSFET 118. random charge on the floating 
gate 118 arising during a fabrication process must be removed in an initialisation 
process. This is achieved by exposing the circuit 100 to ultra-violet radiation through 
5 a metal screen 142. The screen 142 has a hole 144 aligned so that it is above a 
region where the control gate 132 overlaps the floating gate 118. In the presence of 
ultra-violet radiation, the floating gate 118 is effectively shorted to the control gate 
132 through a large resistance, and the floating gate reaches equilibrium with a 
potential close to a potential set on the select tine 112. The voltage applied to the 

10 select line 112 dunng the ultra-violet irradiation should be slightly greater than the 
normal maximum operating voltage, which is 5 V. If the voltage is set at 6 V. when 
the MOSFET 116 is de-selected, with the voltage on the line 112 being at 5 V, and a 
ratio of Cp. / C,o, equal to 0.6, the floating gate potential would be at approximately 
5.4 V. When the MOSFET 116 is selected, the potential on the line 112 being 0 V. 

15 then the floating gate potential would be at 2.4 V. low enough to turn the device on 
This initialisation process thus ensures that de-selected devices are turned off whilst 
only selected devices are turned on. 

After the initialisation process has been performed, each pixel circuit is trimmed to 
20 remove inter-pixel variations. In this process, the detector unit 52 of Figure 2 is 
biased into its normal operating mode and a uniform illumination is applied to the 
detector array 54. The output from each pixel is then compared to a desired output. 
If these two values are not within the required tolerance, then logic elements (not 
shown) switches a high voltage pulse onto the required injector select line. If the 
25 voltage on the floating gate 118 requires raising, the line 112 is set to 0 V and the 
high voltage pulse is switched onto the injector select line connected to the injector 
136. The floating gate potential on other devices in the same row are substantially 
unchanged since their respective select lines are set at 5 V. 

30 Increasing the potential on the floating gates of the MOSFETs such as MOSFET 116 
has the effect of decreasing the current through the floating gate device and the 
output voltage placed on the row output line such as the row output line 110 will be 
reduced. The desired output voltage must therefore be lower than the lowest 
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expected initial voltage after the initialisation process. Each pixei is programmed w,t. 
several pulses until the output voltage is equal to the desired value. 

Referring now to Figure 5 there is shown a circuit 200 suitable for routing a hign 
5 voltage pulse onto the injector select lines of the Figure 3 circu.t. The circuit 200 ,s 
described by J.R.Mann in Floating-gate circuits in MOSIS". Technical Report 824.. 
Massachusetts Institute of Technology. Lincoln Laboratory, November 1990. The 
circuit 200 compnses two pairs of p-channel MOSFETs 202 to 208 connected in 
senes A positive high voltage s.gnal is switched to an output line 210 by switching a 
10 low voltage input signal and its complement to respective n-channel MOSFETs 212 
and 214 The devices in the circuit 200 are configured so as to have an increased 
breakdown voltage compared with conventional MOSFETs As described by Mann 
,ow dose implants are used to modify the device dram structure In operation, the 
circuit 200 provides 14.4 V pulses. This voltage will produce an estimated 
15 programming current of 0.2 pA. It .s estimated that under these conditions 
deselected floating gate MOSFETs receive a programming current of approximately 
10-° pA If the high voltage pulse is applied for 10 ^s, then with a total floating gate 
capacitance of 0.1 pF, each pulse causes a shift in the potential on the floating gate 
of 20 mV. If the initial offset error was 50 mV. two thousand five hundred pulses 
20 would be required to trim one pixel circuit. 

Whilst the pixel circuit 100 has been descnbed as incorporating a bipolar 
phototransistor 102, other forms of photodetector could be incorporated into a p.xei 
circuit Bipolar detectors are suitable for use at low levels of illumination. However, 
above illumination levels of approximately 1 W/m^ corresponding to office lighting 
conditions, a bipolar device may create too much photocurrent and the load devices 
operate non-togarithmically. At illumination levels of 1 kW/m^ corresponding to bnght 
sunlight the load dev.ces would operate in saturation rather than subthreshold The 
phototransistor 102 may be replaced by a photodiode. A photodiode of area 10 rr 
generates a photocurrent of approximately 25 pA under an illumination level o: 
1 w/m^ If the photocurrent exceeds a maximum value of typically 100 nA^ tne 
exponential current voltage characteristic is no longer valid For a 10 m 
photodiode. this current corresponds to an illumination level of 1 kW/m , equivalent to 
oright sunlight. Brighter illumination levels will lead to a non-loganthmic response 



25 



30 
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though deviations from ideal will be gradual, and the upper limit is therefore a soft 
limit. 

The lowest usable illumination level is determined by the response speed of the 
5 detector. When the illumination level, and hence the photocurrent, changes, the gate 
voltages of the load devices must change to balance the current flow within the pixel. 
This response is delayed by capacitances within the pixel. Load devices of size 
10 um X 10 i^m give a load capacitance of 200 fF. Assuming this capacitance C is 
discharged by the change in photocurrent A/p, resulting in a change in output voltage 

10 sV, the time constant t is approximately equal to CAV/Al^, For a one percent change 
in photocurrent, ^V for a photodiode is approximately 1 mV. which under office 
lighting conditions gives a value of x of 0.16 ms which would be suitable for 
resampling the pixel at 50 Hz. In moon-light, a photocurrent of 25 fA could be 
expected with an associated time constant of 160 ms. A photodiode would thus 

15 respond too slowly under these lighting conditions. Bipolar phototransistors proved 
greater photocurrent and so are better suited to low light levels. In order to use 
phototransistor based pixels over a wide range of illumination levels, a detector could 
be fitted with an automatic iris. It may be possible to replace the photodetector and 
the associated load devices with a photovoltaic device, such as that described by 

20 J.Mann in SPiE. Volume 1473, "Visual information Processing: From Neurons to 
Chips . (1991). pages 128 to 136. 

Referring now to Figure 6. there is shown a section of the Figure 2 bar filter unit 58. 
The bar filter unit 58 comprises fourteen columns of circuit elements such as a circuit 

25 element 220 and a single column of circuit elements such as a circuit element 222. 
There are seven columns of circuit elements such as the element 220 on either side 
of the column of circuit elements such as the circuit element 222. There is some 
commonality of components between the elements 220 and 222. Each element 220 
and 222 includes a buffer unit 230. The buffer units 230 are part of a sample and 

30 hold arrangement for passing data across the bar filter unit 58. Each element 220 
and 222 include a transmission gate 232 and a capacitance 234. The transmission 
gates 232 act as switches which can connect and disconnect an output from one 
buffer unit 230 from the capacitance 234 to its immediate right. Data is moved 
across a row by closing each transmission gate in turn starting from the right using a 
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vertical control line (not shown) which controls all the equivalent transmission gates ir. 
each column. If a transmission gate is closed when all the others in the same row 
are open, the result will be to shift data across the array to the right. 

5 Figure 7 shows a diagram of a buffer unit 230 at component level. The buffer unit is 
a standard transconductance amplifier having two well-connected p-channe! 
MOSFETs 250 and 252. A well-connected MOSFET is a MOSFET which has a 
substrate which is electrically connected to its source. The MOSFETs 250 and 252 
are connected to form a source coupled pair. The gate of the MOSFET 252 is 

10 connected to an output 254 which itself is connected to the drain of the MOSFET 
252. The buffer unit 230 has two n-channel MOSFETs 256 and 258, the gates of 
which are connected together. The MOSFET 256 is diode connected with the source 
and gate being connected together. A voltage at a node b3 from a signal line (not 
shown) controls current flowing in to the buffer unit 230 through a p-channel 

15 MOSFET 260. 

Referhng again to Figure 6. the elements 220 and 222 will now be described in more 
detail. Apart from the sample and hold units, the elements 220 and 222 include 
respective averaging units 274 and 276 for calculating a local average response. 
20 The averaging units 274 and 276 are each a modified operational transconductance 
amplifier The averaging units 274 and 276 are substantially simdar but each 
averaging unit 276 includes an additional MOSFET 278 for providing an output. 

The filtered outputs from the central column of circuits 222 are connected to an 
25 output line 280 through respective transmission gates 282. The output line 280 is in 
turn is connected to the Figure 2 imaging unit output 66. The averaging units 274 
and 276 each have an output 284 which connects each unit to its four nearest 
neighbours. The outputs 284 pass through respective transmission gates 286 to 
biasing units 288 which allow current injected from an output 284 to spread between 
30 neighbounng units such that the voltage at which the current is injected represents a 
local average of the pixel voltages. For clarity of illustration, vertical connections 
between neighbouring biasing units 288 are not shown in Figure 6. 
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Figure 8a snows an averaging unit 274 in component form. The unit 274 has two p- 
channel MOSFETs 380 and 382 which are biased by potentials at nodes b1 and b2 
respectively. The MOSFETs 380 and 382 act as a constant current source 383. The 
potentials at nodes b1 and b2 are created by a source (not shown) comphsing a 
5 current generator connected to two diode connected MOSFETs, the potentials at b1 
and b2 being the respective gate potentials of the two MOSFETs. The unit 274 
receives an input voltage from the Figure 6 capacitor 234 of the circuit element 220 
or 222 immediately to its left in Figure 6 on an input tine 384. The input line 384 is 
connected to the gate of a p-channel MOSFET 386. The unit 274 has a second input 

10 device, a further p-channel MOSFET 388. Both of the MOSFETs 386 and 388 are 
weil-connected - that is, their substrate is connected to their source. The MOSFETs 
386 and 388 are connected to form a source coupled pair with the constant current 
source 383 acting as a common source bias. N-channel floating gate MOSFETs 390 
and 392 act as dram loads to the MOSFETs 386 and 388. Connections between 

15 associated MOSFETs 386/390 and 388/392 are drain to drain. The sources of the 
[^QSPg-fs and 392 are connected to earth; their gates are connected together 
and they act in combination as a current mirror circuit. 



The common gate connection of the MOSFETs 390 and 392 is connected to the 
20 common dram connections of MOSFETs 386 and 390 through an n-channei 
MOSFET 394. When the MOSFET 394 is conducting, it forms a diode connection to 
tne MOSFET 390. which is required for normal operation. The gate of the MOSFET 
394 is connected to a programming rail 396 by a line 398. A p-channe! MOSFET 400 
has its gate connected to the line 398. The drain of the MOSFET 400 is connected tc 
25 the dram of the MOSFET 394 and the gates of the MOSFETs 390 and 392. The 
source of the MOSFET 400 is connected to a V^/g/) rail, not shown in Figure 8a but 
shown in Figure 6 as a rail 402. 



The output 284 of the averaging unit 274 is connected to the common drain 
30 connection of the MOSFETs 388 and 392. The output 284 is also connected to the 
gate of MOSFET 388. A p-channel MOSFET 406 has its gate connected to a first 
column feedback line 408 and its source and drain terminals are connected to the 
output 284 and to a source/drain terminal of an n-channel MOSFET 410. The gate of 
the MOSFET 410 is connected to the programming rail 396 and its other source/drain 
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terminal is connected to a second column feedback line 412. The source/drain 
terminals of the MOSFETs 406 and 410 are not distinguished since the relative 
potentials on these terminals are not predictable. 

5 The operation of the averaging unit 274 will now be described. The constant current 
source 383 feeds a current /,a,/ to a node 414 The magnitude of /fa,,/ is such that the 
MOSFETs of the unit 274 operate in a sub-threshold regime, where the current 

through a device, /c, follows the relationship Iq - Iq e^^9s ^ where Iq is a device 
dependent parameter. The current /,a;/ is divided between the MOSFETs 386 and 

10 388 in a ratio depending on their differential gate voltage. If the gate voltages are 
equal, the same current, /fa,/ /2. flows through each device. When a unit 274 is 
selected, the line 396 is at 5 V, and the MOSFET 394 is conducting The current 
which flows through the MOSFET 390, equal to the current tnrough the MOSFET 
386. is then equal to the current through the MOSFET 392. If there is a voltage 

15 difference between the potentials on the gates of the MOSFETs 386 and 388 then 
current is either injected onto or received from the output 284. The output 284 is 
connected to the outputs of immediately surrounding averaging units and so the 
effect of the averaging unit 274 is that if the voltage input on the line 384 is different 
form the local average input, a current flows and due to resistive effects the local 

20 average voltage changes to a certain degree, thereby updating the local average. 

Whilst the above operation of the averaging unit 274 deschbes the normal operation 
of the unit, it is necessary to carry out a trimming operation in order to reduce the 
effect of variations in Iq between devices within the unit. In the trimming operation, 

25 the potentials on the floating gates of the floating gate MOSFETs 390 and 392 are 
adjusted. In an initialisation step, residual random charge on the floating gate 
devices is removed by exposing the device to ultra-violet radiation. In order to 
achieve this, the floating gate bar filter unit 58 is fabricated with a metal shield layer 
covering most of the circuits; the shield layer having a window above an area where 

30 the control gate overlaps the floating gate. The shield layer also protects the circuit 
from visible light during normal operation. Since areas near to the window will not be 
protected from visible light, the window is placed at the source end of the floating 
gate. The initialisation process is only required to achieve approximate equality 
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between the potentials of the two floating gates. During the initialisation process, the 
line 396 is held at 5 V in order to allow the MOSFET 394 to conduct and the unit 274 
to operate normally. 

5 After initialisation, the unit 274 may be trimmed to counteract device variations. In 
order to tnm the unit 274, a known constant signal, chosen to represent a typical 
signal input and perhaps 2.5 V, is fed into the sample and hold circuits comprising the 
buffer units 230, the transmission gates 232 and the capacitances 234 and therefore 
consequently to the input line 384. The constant signal is supplied from an on-chip 

10 voltage source (not shown) and is connected to the bar filter unit 58 through 
transmission gates (not shown) which selectively connect either the signals from the 
detector unit 52 during normal operation or the constant signal during trimming 
operation. This arrangement enables the trimming of the detector unit 52 and the bar 
filter unit 58 to be carried out in parallel. The units 274 are trimmed one row after 

1 5 another. The row containing the units 274 which are to be trimmed is selected by 
setting the appropriate line 396 high and all other equivalent lines in the unit 58 low. 
A global control signal (not shown) is sent to all the transmission gates 286 in Figure 
6 to disconnect all the units 274 from other similar units. The line 412 is then set to 
the same voltage as the signal on the input line 384 and the line 408 is set low The 

20 MOSFETs 406 and 410 are then conducting. Current flowing in the line 412 is then 
the output current when the two input voltages to the unit 274 are equal and is 
monitored. A double comparator arrangement shown in Figure 9 may be used to 
determine whether the output current should be either increased, decreased, or if 
approximately zero remain unchanged. A double comparator arrangement is 

25 descnbed in FR-A-2 543 363. The current may be changed by putting a high voltage 
puise on either or both of respective programming lines for the floating gate 
MOSFETs 390 and 392. These programming lines are indicated as vertical lines pi 
and p2 respectively connected to units 274 within a column in Figure 6 but are 
omitted from Figure 8a for clarity. The high voltage pulses are supplied by a circuit 

30 similar to the circuit 200 shown in Figure 5. one of which is connected to each 
programming line. 



When a unit 274 is deselected, the line 396 is low and the unit 274 is therefore 
isolated and the channel of the MOSFET 400 is conducting rather than the MOSFET 
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394. The voltage Vt^.g^, is then capacitively coupled through onto the floating gates of 
MOSFETs 390 and 392. In order to ensure selective programming of floating gate 
MOSFETs within a column, the voltage change induced on the floating gates of 
MOSFETs of deselected units must be at least 3 V. This may be controlled by having 
5 a large control-gate to floating-gate coupling capacitance or oy using the largest 
possible value of l/^.g^, which saves circuit area. To turn off the MOSFET 400, the 
voltage which is applied to the line 396 must be at least as high as the voltage V^.gr. 
applied to the source of MOSFET 400. 

10 To compensate for changes due to leakage currents during the trimming operation of 
voltages stored on the capacitances 234, these voltages must be regularly updated 
as the tnmming proceeds. Once the units 274 within a row have been tnmmed, the 
units 274 in a next row are then selected by setting their tine 396 high. 



15 Referhng also now to Figure 8b, there is shown an averaging unit 276 from a circuit 
element 220 of Figure 6. The averaging unit 276 is essentially similar to the 
averaging units 274. the only difference being that the gate of the output MOSFET 
278 is connected to the connection between floating gate devices 424 and 426 
equivalent to the MOSFETs 390 and 392 of the unit 274. The MOSFET 278 is a n- 

20 channel floating gate MOSFET The MOSFET 278 is sensitive to any difference 
between the two input voltages. The gate voltage on the MOSFET 278 controls the 
flow of current through the device. The output of each averaging unit 276 is 
seiectably connected to the output line 280 by respective transmission gates 282. 
each of which is controlled by a respective control signal on a control line Select^ (not 

25 shown). The outputs from averaging units 276 of successive rows are consecutively 
coupled to the output line 280. 

Like the units 274, the floating gate devices 424 and 426 of the unit 276 are 
programmable to trim the operation of the unit 276. The trimming operation for the 
30 unit 276 is the same as for the units 274 with a further step of programming the 
operation of the MOSFET 278. Dunng programming, the respective control line 
Sefecto is connected to the respective line 396 to ensure that the correct output 
device is monitored on the output line 280. The output current from the MOSFET 
278 is adjusted by varying the potential on its floating gate so that a pre-determined 
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output current is obtained for zero differential input. The floating gate of the MOSFET 
278 is programmed by the application of a high voltage on a programming line p3 
Only the floating gate of a selected device is programmed since the floating gates of 
de-selected devices are at a raised potential by virtue of devices equivalent to the 
5 MOSFET 400 coupling the voltage Vn,gt, to the gates of de-selected output devices 
Once the trimming operation is completed, the voltages on the lines 396 are set high 
to ensure normal operation of the units 274 and 276: the lines 408 are set high to 
ensure the lines 284 are isolated from the line 412 and the control line Selecto is 
decoupled from the line 396. 

10 

Refernng now to Figure 9 there is shown a double comparator arrangement 440 
suitable for programming the floating gate MOSFETs 390, 392. 424 and 426 of the 
averaging units 274 and 276. A current measuhng unit 442 measures the current 
flowing on the line 412 and outputs a signal on a line 444 in response to the 

15 measured current. The signal on the line 444 has a value (2.5 ± 5) volts, where 5 is 
dependent on the magnitude of the current. Thus if the current requires increasing, 
the signal is less than 2.5 V and if the current requires decreasing, the signal is 
greater than 2.5 V. The line 444 provides an input 446 to a comparator 448 and an 
input 450 to a comparator 452. A second input 454 to the comparator 448 carries a 

20 voltage V, and a second input 456 to the comparator 452 carries a voltage Vj. is 
slightly less than 2.5 V, perhaps 2.4 V. and Vj is slightly greater than 2.5 V. perhaps 
2.6 V. Altering the values of V, and V2 affects the precision of the trimming process. 
The exact values would be determined by routine testing, balancing the speed of the 
trimming operation against the degree of precision. The differences between 2.5 V 

25 and the values of Vi and Vj provide an acceptable range for the current on line 412. 

The comparator 448 generates a logical '1' on an output 458 when the signal on the 
line 444 is less than V, and a logical '0' when it is greater; similarly the comparator 
452 generates a logical '1' on an output 460 when the signal on the line 444 is 
30 greater than and a logical 0' when it is less. The outputs 458 and 460 provide the 
inputs for a NOR gate 462. The NOR gate 462 provides a signal to a pulse generator 
464 when the output current on the line 412 is within a desired range and hence the 
(^j^^jng operation for a pair of MOSFETs within an averaging unit is complete. 
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The pulse generator 464 generates a series of pulses during the trimming operation. 
These pulses are output to two AND gates 466 and 468. The AND gate 466 carries 
out a logical AND operation on the pulsed output of the puise generator 464 and the 
5 output of the comparator 448, resulting in a signal Si. The AND gate 468 carries out 
a logical AND operation on the pulsed output of the pulse generator 464 and the 
output of the comparator 452. resulting in a signal S2- The signal Si controls 
switches (not shown) which switch the low voltage input signals to a high voltage 
pulse routing circuit (not shown) as shown in Figure 5 which provides a pulse on the 

10 programming line p1 to program MOSFETs 390 or 424 as appropriate. The signal S2 
controls switches (not shown) which switch low voltage input signals to a further high 
voltage routing circuit (not shown) which provides a pulse on the programming line p2 
to program MOSFETs 392 or 426 as appropnate. A puise is thus only sent to a 
respective one of the pair of floating gate MOSFETs of the averaging units when 

15 either of the comparators 448 and 452 generates a logical '1', indicating that further 
adjustment of the current on the line 412 is required. A pulse cannot be sent to both 
MOSFETs of an averaging unit simultaneously. The potential of the floating gate of 
the MOSFETs 390 or 424 are increased if the current in the line 412 requires 
increasing and the potential of the floating gate of the MOSFETs 392 or 426 are 

20 increased if the current in the line 412 requires reducing. 

There is a time lapse m successive pulses from the pulse generator 464 which ts 
sufficient for the averaging units and comparators to react after the end of a pulse to 
produce a new value of the current on the line 412 and new logic signals pnor to the 
25 next pulse. Once the pulse generator receives a signal from the NOR gate that the 
tnmming of a particular averaging unit is complete, the trimming of the next averaging 
unit is initiated by a signal sent to a logic unit (not shown) which controls the setting of 
the lines 396. 

30 Referring now also to Figure 10 there is shown one of the biasing units 288 which is 
similar to the prior art transconductance amplifier 38 but with the arrangement 
inverted and the device type changed. The biasing unit 288 comprises a bias circuit 
490 and an arrangement of lateral connections 492. The bias circuit 490 comphses 
two p-channei MOSFETs 500 and 502 and two n-channel MOSFETs 504 and 505. 
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The drains of the MOSFETs 500 and 502 are connected together and connected to 
the drain of an n-channel MOSFET 508. The gates of the MOSFETs 504 and 506 
are linked together. The gate of the MOSFET 500 is connected by an input line 510 
to an output 512 of a transmission gate 286. The MOSFET 502 is diode connected. 
5 A further diode connected p-channel MOSFET 514 is positioned between the 
MOSFETs 502 and 506. The arrangement of lateral connections 492 comprises four 
p-channel MOSFETs 516 to 522 The gate of the MOSFET 514 is connected to the 
gates of the four p-channel MOSFETs 516 to 522. One of the source/drain contacts 
cf each MOSFET 516 to 522 is connected to the output 512 and the other 
10 source/drain contact of each MOSFET is connected to a respective output to a 
neighbouring biasing unit. 

The conductance of the bias circuit 490 is controlled by in input voltage Vp applied to 
the gate of the MOSFET 508. When a signal is injected into a laterally connected 
15 network, the voltage generated by the input decreases as a function of distance from 
the input because some of the current injected by the input is shunted to ground. For 
an array of nodes connected together by a resistance R and with a conductance G to 
ground at each node, the voltage, V„. at a point n sections away from a source, Vq. 
will be 



20 



where 



1 1 1^, 1 

/I + — 

Vo 2L^ I- V 4Z.' 



25 V = = 1 - ^ - - ;1 + -y 



where L is a characteristic length, or diffusion length, such that ML is equal to sIRG 
The input voltage Vr to the bias circuit 490 controls the conductance to ground of the 
resistive bias circuit. Changing Vp thus changes the characteristic length L of the 
30 filter. Simulation results show that characteristic length of two for a filter with fifteen 
columns performs well, and a characteristic length of four behaves acceptably. 
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Returning to Figure 2, the imaging unit 50 has been described as including an array 
54 of 512 X 512 pixels. The averaging process performed by the bar filter unit 58 is 
such that a filtered output is not obtainable for pixels in a border region of the array 
54. Since the bar filter unit 58 compnses fifteen columns of circuit elements 220 and 
5 222. with the circuit elements 222 forming a central column, data from the first seven 
columns of the array 54 are passed across the bar filter unit 58 with no output from 
the central column being measured. Only when the bar filter unit 58 is filied are 
outputs taken from the central column. Likewise, no output is measured from the last 
seven columns of the array 54, There will also be pixels from top and bottom of the 

10 array 54 which do not contribute to a final image. This is due to edge effects 
preventing a meaningful local average being obtained for the rows closest to the top 
and bottom of the array 54. For symmetry reasons, data from the top and bottom 
seven rows is discarded. After conventional signal processing to convert signals from, 
the imaging unit output 66 of the central column of the bar filter unit 58 into an image 

15 for displaying on for example a television screen, a final image of 498 x 498 pixels is 
produced. 

In order to understand the operation of the averaging units 274 and 276 more fully, 
the characteristics of a simple transconductance amplifier 600 taking the place of the 

20 averaging unit 274 will now be discussed. The amplifier 600 compnses four 
MOSFETs M1, M2. M3, and M4. The MOSFETs Ml and M2 are p-channel and the 
MOSFETs MS and M4 are n-channel. There are two signal inputs to the amplifier 
600 In1 and ln2 and the amplifier has a current output lom- The output current from a 
transconductance amplifier operating in subthreshold is /^^^ = Ita.i tanh(K sV,^) 

25 Within this circuit, Iq variations will cause errors in the differential input voltage, AV,r, 
and the size of the output current. The size of the injected current for a paaicular 
differential input voltage determines the extent over which the average response is 
calculated and is therefore equivalent to errors in the biasing jnits 288. which are 
considered to be negligible. This source of errors will therefore also be negligible 

30 Simulations suggest that it is the errors AV,r which are equivalent to errors in the 
signal representing the scene, which must be minimised. 



If the gate voltages of the two input devices, Ml and M2. are equal there are two 
mechanisms which could lead to a non-zero output current. A residual source-dram 
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voltage dependence of the current in devices M1 to M4 vj\\\ lead to a non-zero current 
even where device variations are excluded. This is common to all circuits and is 
therefore a systematic error Variations between devices in the matched pairs 
M1/M2 and M3/M4 create a random current which vanes between individual circuits. 

5 

The systematic error can only be minimised during the design of the circuit. 
Unfortunately, since it depends upon the source-drain voltages within the circuit it 
changes as the input voltage varies. Thus it is only zero at one particular input 
voltage. At all other input voltages there will be a finite output current for a zero 

10 differential input. This input dependence of the systematic error means that the ideal 
condition, that zero current is injected into the lateral network in response to a zero 
differential input, is unattainable. In order to understand the impact of a systematic 
error consider a number of transconductance amplifiers configured to inject current 
into a lateral network. If the input voltage to all the circuits is the same and the 

15 circuits all have the same error, then symmetry means that all the nodes in the 
lateral network will be at the same voltage. There will therefore be no lateral current 
flow and the voltage on each node of the lateral network must be the voltage which 
results in a zero output current. The differential voltage across each of the 
transconductance amplifiers will be identical. This suggests that systematic errors, 

20 which are common to all circuits, will not introduce output errors which will obscure 
detail in an image. Thus systematic errors can be tolerated, although they should be 
minimised whenever possible. Any random errors, which are different in each of the 
transconductance amplifiers, will introduce errors in the system output which will 
obscure detail within the scene. These random errors must therefore be minimised in 

25 order to increase the system sensitivity. Since random errors arise from variations 
between individual devices they are usually minimised by increasing the size of the 
devices to reduces the vanation between devices. Unfortunately, the results obtained 
by Pavasovic, Andreou and Westgate. reported in Journal of VLSI Signal Processing, 
Volume 8 (1994) page 75, suggest that this will only reliably reduce one component 

30 of the vanations between devices. An alternative technique for reducing random 
variations, using floating-gate devices within the circuit, was therefore investigated. 

The impact of variations in Iq will now be considered. With zero differential input 
assume that the current through the device M2 is constant. The output current will be 
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zero if this current is equal to the current through the other input device. M1 after it 
has been mirrored through the devices M3 and M4. When a current mirror operates 

in subthreshold l^^ = ^/vfi ^o.mz hence the output current from the mirror can be 

adjusted by changing Iq.mj or Iqma- Changing the charge on a floating-gate device. 
5 when the channel is biased to operate subthreshold, is equivalent to varying the /'o 
parameter. Considering the effect of variations, changing the input devices M1 and 
M2 to floating gate devices will reduce the channel conductance of these devices 
and therefore the circuit gain. Therefore, changing the load devices to floating gate 
devices should be considered Replacing the MOSFETs M3 and M4 in the current 
10 mirror by floating-gate devices will create the flexibility required to ensure that a zero 
differential input leads to a zero output current. Furthermore, increasing Iqxi3 will 
increase Ima whilst increasing Io,m4 will decrease Im4- Thus, the two floating-gate 
devices can be used in conjunction with a single polarity high-voltage programming 
voltage to thm a circuit to remove the random variations. 

15 

The ability to trim a circuit with floating-gate devices in the current mirror has been 
confirmed by simulation. During the simulations, the circuit being trimmed was 
configured as a buffer so that any errors appear as an offset voltage which can be 
equated to an error in the input. For the particular circuit simulated the systematic 
20 offset with an input of 2 V was found to be 3.7 mV varying to -2.4 mV at an input 
voltage of 3V. Introducing Iq variations of 10% into the two input devices, by varying 
the width of these devices, led to offset voltages at 2 V in the range -6.0 mV to 13.7 
mV. The simulation results showed that all the circuits could be tnmmed to remove 
this random variation, leaving a population with a tolerable systematic error. 

25 

The ability to remove the random vahations between circuits, which anse from 
differences in the value of Iq between devices means that variations in k must be 
considered. In order to save area a transconductance amplifier is usually designed 
with the substrate in which the source-connected input devices are fabricated 
30 connected to the appropnate power rail. For these devices with a varying gate- 
substrate potential, Vgt,. the current voltage characteristic is 
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5 



Since for this layout. V^j^, will vary with the common-mode input voltage, variations in 
K. AK, wili create an effective Iq, where 



/; = /n expfAKlgi, / Ur) 



which varies with the gate-substrate potential. Since the gate-substrate potential wilt 
change with changes to the input, this means that'the IqS of the two input devices 

10 will vary differently with changes to the input. In effect the K variations will create an 
input-dependent offset voltage which varies between different circuits. This variation 
means that a population of circuits can only be trimmed to have the same offset at a 
one particular input. Variations away from this value will create random offset 
voltages which reduce the accuracy with which the local average is calculated. The 

15 problems caused by variations in K only ahse if Vgo also varies. These vanations 
wili therefore not cause problems in any circuit in which this potential is approximately 
constant. To a good approximation this situation arises in the current mirrors and in 
source-coupled devices whose local substrate is connected to the common-source. 
This suggests that the problems arising from vanations in K can be alleviated if the 

20 source-coupted devices are well-connected. Simulations of circuits with this layout 
show that the systematic offset voltage is independent of the particular combination 
of K parameters in the source-coupled and current mirror devices. Thus with this 
circuit configuration floating-gate devices in the current mirror can remove Iq 
variations, and the systematic error between circuits induced by K variations is 

25 consistent to a fraction of a millivolt. With floating-gate devices used to trim the 
averaging units 276. the final stage of trimming the averaging unit is to trim the output 
MOSFET 278. These devices in each of the circuits must be trimmed to ensure that 
there is a uniform response to a uniform input scene. However, since the devices 
can only be programmed to increase the potential on the floating-gate, the target 

30 current for the trimming process, i.e. the current which represents a scene with zero 
contrast, must be set sufficiently high to ensure that the floating-gate potential of ail 
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devices must be increased. If this condition is satisfied then a population of output 
devices can be tnmmed to ensure the desired response. Overall, simulation results 
show that using well-connected input devices and two floating-gate toad devices. ;t 
will be possible to trim a population of circuits so that they are all almost identical 
5 Furthermore, a floating-gate device can be used to trim the output devices to ensure 
that there is no subsequent degradation of sensitivity. 



The imaging system 50 of Figure 2 may be incorporated within a surveillance system. 
Referring now to Figure 12, there is shown a surveillance system 650. The system 

10 650 comprises an imaging system 660 and a display system 662. The imaging 
system 660 is similar to the imaging system 50. Image signals from successive 
pixels within a column and from successive columns are passed from the imaging 
system 660 to the display system 652 along a data tine 664 The signals from the 
imaging system 660 control the intensities of display pixels (not shown) within the 

15 display system 662 in a manner familiar to those knowledgeable about display 
technologies. 

The surveillance system 650 provides advantages over pnor systems in that the 
(jiegree to which local illumination determines the appearance of an object within a 

20 scene is reduced. In a conventional video camera based system, if there are regions 
of intense brightness within an overall dark scene, then the automatic gain control on 
the camera will result in objects within the dark background becoming indiscernible 
Such a scenario might be at night when the bnghtness of an approaching car s 
headlights render all surrounding information indiscernible Another possible 

25 scenario might be a surveillance camera in a city at night where, as a result of locally 
intense street lighting, objects in shadow are hidden. 



The number of bits which describe the pixel intensity may be selected according :o 
the quality of image required. In certain situations, it might be desirable for an image 
30 to be represented by one bit per pixel. Whilst for a standard image, the quality 
deteriorates rapidly as the number of bits is reduced, the image quality of an image 
generated by the system 660 degrades gracefully as the number of bits is reduced. 
Even with a one bit per pixel representation, images are recognisable since edges 
present in a scene are preserved. 
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The imaging system 50 represents a fully integrated system in which the logarithmic 
response and the spatial filtering are achieved on a single integrated circuit. 
Intearating the system 50 on a single integrated circuit provides advantages in terms 
5 of compactness and power consumption. Other surveillance systems incorporating 
means for generating a logarithmic response to incident radiation and subsequent 
spatial filtehng may be constructed. 

Referhng to Figure 13 there is shown an imaging system 700 comprising a detector 
10 array 710. a signal digitiser 712 and a digital processor 714. The detector array 
compnses an array of photodetectors 716. The photodetectors 716 may be photo- 
transistors or photo-diodes with a select device to allow the current from each pixel 
within a column to be selectively connected to an output 718 which is common to 
each row. Connecting the small photo-currents to the relatively large capacitances 
15 which anse from using a common row output may limit the speed of operation of the 
array. This can be avoided by using a buffer which holds the output line at a constant 
voltage. In order to avoid large changes in the voltages internal to each pixel, any 
unselected devices can be connected to a second common line which is held at the 
same voltage. Such a system is described by Mead and Delbruck in Analog 
20 Integrated Circuits and Signal Processing. Volume 1 (1991). pages 93 to 106. 

The signals from the array 710 are passed to the digitiser 712. In order to be able to 
detect intensity changes at a ievei of 1%. the maximum sensitivity of the eye. over an 
intensity range of three decades, the digitiser 712 would need to be capable of 
25 digitising signals from the photodetectors at an accuracy of approximately 17 bits per 
pixel. This figure of 17 is determined from the expression: 

^Ho.oiJ 

30 For a 512 X 512 pixel array and a frame rate of 50 Hz. the digitisation would have to 
be performed at a rate of 13 MHz. An analogue to digital converter capable of 
meeting these requirements would be difficult to design and so the minimum contrast 
and the intensity range have to be compromised. The digitiser 712 may incorporate 
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anaiogue to digital converters produced by Analog Devices in their senes 
AD9022/AD9026 which are advertised as being capable of 12-bit conversion at over 

20 MHz. 

5 The digitised signals are passed to the processor 714. The processor 714 calculates 
the logarithm of the digitised signals and performs a high pass filtering operation on 
the result. The high pass filtenng may be achieved in the spatial domain by 
performing a convolution operation with a suitable kernel familiar to those skilled in 
image processing. After the filtenng operation, the processor 714 sends signals to a 
10 display unit 716 which processes the signals from the processor 714 and displays the 
resulting image. Again, the number of bits representing the final image may be 
selected according to the clarity of image required and other considerations such as 
possible image recognition algorithms or data storage and/or transmission 
requirements. 

15 

It is desirable to represent a scene with a given percentage error over the widest 
possible range of illumination levels. The system 700 with its linear representation 
suffers from the disadvantage that bright features will be represented too accurately 
whilst low brightness features will not be represented accurately enough. This 
20 disadvantage may be overcome by obtaining an analogue logarithmic representation 
prior to digitisation. 

in such an embodiment, the number of bits required in a digitised signal to represent 
a 1% change in intensity over an intensity range of three decades is reduced to 
25 approximately 10 as determined from the expression: 

1092 I — - ^ ^° 



30 



V in (1-01); 



An approach for obtaining a logarithmic representation is to include a logarithmic 
current-sense amplifier before the output 718. Such an amplifier is descnbed in the 
previously referenced paper by Mead and Delbruck. The output voltage, Vo^r, of such 
an amplifier is given therein as being determined by the expression 
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_ Vref - kT / q ln(l / fp) 

when the current, /, is sub-threshold. Since the iogahthm is determined prior to 
5 digitisation, there is nor requirement for the processor 714 to calculate a logarithm 
TYom the output of the digitiser 712. If the digitised output of the logarithmic signal 
has 8-bit accuracy, this is equivalent in dynamic range and sensitivity to a 10-bit 
digitised linear signal. Furthermore, a 10-bit output, capable of dealing with an input 
dynamic range of more than four orders of magnitude, will have a larger dynamic 
10 range than the human eye, and a much wider dynamic range than using 10 bits with 
a linear system which would only represent a one per cent change in photon flux over 
one decade change in illumination level. 

Individual detectors within the array 710 will be subject to variations in performance 
15 and will create a non-uniform response which may be equivalent to a 10% change in 
contrast. A non-uniformity correction step will therefore be required after digitisation 
in order to prevent these variations from obscuring the fine details within a scene 
Such a non-uniformity correction step could be performed by the processor 714 prior 
to the calculation of the logarithmic response by multiplying the digitised signal from 
20 each pixel by a scaling factor determined in a calibration routine, or more accurately 
multiplying the signal by an interpolated correction factor determined using a senes of 
calibration values obtained over a range of illumination levels. Alternatively, the 
correction could be achieved by subtracting a correction value after the logarithmic 
response has been calculated. 

25 

Mead and Delbruck suggest that it would be difficult to operate a large array at the 
frame rate for low photo-currents of possibly 10 pA, expected at low illumination 
levels. One of the major problems is the need to prevent "ringing". One approach to 
overcome this is to employ "smart" sensor concepts which predict the final output 
30 from a ringing signal without waiting for the ringing to stop. A further approach is to 
replace the voltage mode buffer circuit described by Mead and Deibruck with a 
current mode buffer circuit which holds the output node at a fixed voltage. Without 
these solutions, the system may be limited to small arrays operating at illumination 
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levels which produce nanoamp photocurrents. Figure 14 shows a current mode 
buffer circuit 750 for achieving a solution to this problem. 

The circuit 750 comprises six p-channel MOSFETs 752 to 762 and three n-channel 
5 MOSFETs 764 to 768. MOSFETs 752, 754. and 756 are matched MOSFETs. as are 
MOSFETs 764, 766, and 768, and MOSFET pair 760 and 762. The detector array 
710 is connected to a node 770. to provide an input current, The symmetry of the 
layout of MOSFETs 760 and 766 mean that the node 770 is held at a constant 
voltage determined by a voltage source V,^. The load capacitance for changes in the 

10 input current are the capacitances associated with the current mirrors formed by 
MOSFETs 764, 766, and 768. In order to reduce the response time, a bias current 
L is added to the input current l,^ from MOSFET 754. This bias current is 
generated by attaching a current sink to MOSFET 752. This generates a voltage at 
the node 770 which is distributed to MOSFETs 754 and 756. The summed current Z,, 

15 + /b;as is copied into MOSFET 768. MOSFET 756 then supplies current 1^,,^^ so that 
the current which flows through MOSFET 758 is /,^. This current is converted to a 
voltage which is a logarithmic representation of this current by MOSFET 758 which is 
diode-connected, in order to increase the speed at which the circuit 750 operates. 
MOSFETs 755 and 768 may be replaced by several MOSFETs which are the same 

20 as MOSFETs 752 and 764 respectively. If n MOSFETs are used in parallel in these 
positions, then the circuit will operate n-times faster. 

in an alternative system, a current-voltage conversion may be performed within the 
pixel, followed by a buffer circuit such as a source-follower. The current to voltage 

25 conversion should create a voltage which is proportional to the logarithm of the 
photo-current in order to avoid the previously discussed problems of a linear 
representation. Such a conversion may be achieved using diode connected load 
MOSFETs operating in the sub-threshold regime. The photodetectors 716 of the 
array 710 may be replaced by logarithmic photodetector circuits such as the receptor 

30 unit 20 of Figure 1 . Whilst non-uniformity corrections to the outputs of the logarithmic 
photodetector circuits could be performed after digitisation, the result of performing 
non-uniformity correction digitally would be to produce a corrected output which 
would be accurate to one less bit than the uncorrected input. This may be avoided by 
implementing non-uniformity correction within the detector array. Such a system 
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would include an array of photodetectors similar to the array 54 of the imaging unit 50 
of Figure 2. Instead of the output being passed to an analogue filter unit, the output 
of the array could be digitised and the resulting digital signals filtered in the spatial 
domain using a convolution process. In cost-sensitive markets, the digitiser accuracy 
5 is often reduced to a minimum in order to cut costs On-chip non-uniformity 
correction would give a factor of 2 more dynamic range for a given digitiser accuracy. 

The filtenng operation in the spatial domain may be filter operation using a 6- 
Gaussian filter. Digitally, this would be implemented using a convolution kernel 



10 



= ^o, . - Bexp(-/2 / 2a2)exp(-;2 / 2a 2), 

15 where a is the width of the filter and A and B are normalisation factors, defined so 
that 

20 This normalisation gives the maximum reduction in dynamic range, resulting in an 
image dependent only on the local contrast. In order to eliminate only the very low 
spatial frequencies from the image, values of a of about 2 or more are required. If 
a = 2 then a kernel of dimensions approximately 15 x 15 is needed to represent the 
Gaussian sufficiently accurately, with larger values of a requiring even larger kernels. 

25 

A general kernel operating on a 512 x 512 image at 50 Hz would require a digital 
processor capable of approximately 512^ x 15^ x 50 . or 3 x 10^ multiplication and 
addition operations per second. However, the separability of the Gaussian kernel 
into horizontal and vertical parts means that the 15 x 15 kernel can be replaced by 
30 two 15 X 1 kernels, requiring only 512^ x 2 x 15 x 50, or 4 x 10^ multiplication and 
addition operations per second. After application of the two convolutions, the 
resulting image must be subtracted from the onginal logarithmic image suitably 
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normalised. Using the 1 -dimensional filters is nearly an order of magnitude less 
computationally expensive than using a 2-dimensional filter. Th,s results in a 
reduction in the required system performance, and so leads to a simpler architecture. 
A plan of the convolution filler architecture for a 1 -dimensional filter ,s shown .n 

5 Figure 15. 

Analogue spatial filtering of a corrected logarithmic detector output may be achieved 
using an averaging unit similar to the lateral averaging unit 22 of the Figure 1 system. 
This would consume less power than the digital alternatives and may be cheaper for 
10 manufacture in large numbers. 

The fully integrated system 660 would be the most compact and reliable system and 
may consume less power, important for battery operated systems. 

15 imaging systems such as those described above which incorporate a logarithmic 
representation of a scene which has undergone a high-pass filter operation would be 
suitable for use in surveillance systems. Such systems would be particularly useful 
for imaging natural scenes where there is a wide variation in illumination levels, such 
as regions in shadow and regions in bright sunlight. 



20 



25 



30 



Logarithmic detectors and high-pass spatial filters may be combined to produce a 
contrast encoded, edge-enhanced representation of a visual scene. Refernng to 
Figure 16 there is shown a simulation of a representation of a village scene before 
and after filtering. Figure 16a shows an image which would have been obtained with 
a conventional imaging system, for example a video camera. Figure 16b shows the 
same image after logarithmic conversion and spatial filtering. Figure 17 shows a 
representation of a road scene before and after filtering Figure 17a shows an image 
which would have been obtained from a conventional imaging system and Figure 17b 
shows the same image after logarithmic conversion and spatial filtering. Figures 16b 
and 17b were obtained from a linear detector and were subjected to digital 
processing in a manner similar to that described with reference to the system 700 of 
Figure 13. vy^ith a difference being that the images were captured using a CCD 
camera The edge around the filtered image in Figure 16ta anses because the 
convolution operation results in an image which is smaller than the input. The filter 
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operation used to produce the filtered images shown in Figures 16b and 17b had a a,n 
value of two. 

Figure 18 shows in graphical form the distribution of the pixel intensity values of the 
5 Figure 16 and Figure 17 innages. Figure 18a shows the disthbution of intensity 
values in the filtered outputs. A solid line 800 is a plot of the pixel intensity 
disthbution from Figure 16b and a solid line 802 is a plot of the pixel intensity 
distribution from Figure 17b. Figure 18b shows the disthbution of intensity values in 
the filtered outputs. A solid line 804 is a plot of the pixel intensity disthbution from 

10 Figure 16a and a solid line 806 is a plot of the pixel intensity disthbution from Figure 
17a. Companng Figure 18a with Figure 18b, the distributions in intensities in Figure 
18a is considerably narrower than those In Figure 18b. The disthbution intensities in 
Figure 18a show a uni-modal disthbution centred around a particular intensity. Since 
the disthbutions in Figure 18a are narrower than those in Figure 18b, it follows that 

15 the image can be represented in fewer bits. Analysis of Figure 18a indicates that 
Figures 16b and 17b could be represented using as few as five bits per pixel. 

As a companson. Figure 19 shows the images of Figure 16 digitised so as to be 
represented by three bits per pixel. Figure 19a represents a digitisation of figure 16a 

20 and Figure 19b represents a filtered output. Figure 20 is a representation of the 
Figure 16 image in which, after a threshold has been imposed, the image is 
represented by a single bit per pixel. Such a representation still contains 
recognisable detail and may be a suitable format for image recognition algorithms to 
operate on. as well as reducing the amount of data which a data storage system 

25 would have to store. 

The imaging systems deschbed above may be incorporated into surveillance systems 
for use in observing natural scenes. There is a requirement for an imaging system 
which is capable of imaging objects at night even in the presence of intense light 
30 sources in the image. An example of an application for such a system is for night- 
time surveillance of motor traffic. Figure 21 is a simulation of the response of a 
conventional imaging system when imaging a car at night. As can be seen from 
Figure 21. the effect of the car's headlights is to cause the obliteration of most of the 
detail of the car Figure 22 is a simulation of the same image which would be 




# 
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produced by an imaging system comprising a logarithmic detector and a spatial filter. 
Whilst the dazzle effect of the car's headlights has been reduced, the resulting image 
of the car is faint due to a large number of photons being scattered from the 
headlights. Figure 23 is a simulation of the same image in which a linear current- 
5 mode detector is used to capture the image and after digital processing to filter the 
image spatialiy. In the spatial filter, a local estimate of the additional photons from 
the headlights is subtracted from the response of each pixel. A system for obtaining 
the image of Figure 23 would comprise a high-dynamic range detector array together 
with a high dynamic range digitiser and a digital processor; in other words, similar to 
10 the system 700 without the logarithmic conversion. Whilst Figures 21 to 23 are 
simulations of night-time scenes, it may be seen that such a system would be 
capable of identifying important features, such as a car s registration identity, without 
being dazzled. 

15 A further passible application for imaging systems comprising a logarithmic response 
photodetector and filtenng means is in an electronic photographic system. Currently 
available electronic cameras rely on a combination of limited resolution, limited 
picture storage capability and image compression techniques to achieve a realistic 
performance. An electronic photographic system which generated a logarithmic 

20 representation of an image and filtered the image would have a lower data storage 
requirement, which would be of benefit in increasing the number of pictures which 
couid be stored, or the resolution, or both. Pnor to the display of images stored by 
such a system, the logarithmic representation of the image could be converted back 
to a linear representation for either displaying on a screen or for printing using a 

25 standard printer. For use as a portable camera, power consumption would be of 
critical importance and so the system 50 might be the most suitable for incorporation 
into such a camera. 
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1 An imaging system (50) comprising detecting means (52) for detecting 
electromagnetic radiation from an imaged scene and for generating pixel 
image signals in response thereto and processing means (58) for filtenng 
spatially the pixel image signals and for generating processed image signals 
having a dynamic range which is less than that of the imaged scene, 
characterized in that the processing means (58) is spatially separated from 
the detecting means (52). 

2. A system according to Claim 1. characterized in that the detecting means (52) 
provides means for generating pixel image signals whose respective 
magnitude is a non-linear function of an image intensity at a respective pixel. 

3. A system according to Claim 2, characterized in that the detecting means (52) 
provides means for generating pixel image signals each with a magnitude 
substantially proportional to the logarithm of the image intensity at that pixel. 

4. A system according to Claim 3. characterized in that the system comprises: 

(i) an array of pixel elements, each pixel element providing means for 
generating a pixel signal having a magnitude substantially proportional 
to the intensity of the image at the pixel. 

(ii) means for digitising the pixel signals, and 

(iii) means for converting the digitised pixel signals into a logarithmic 
representation and for filtenng the logarithmic representation spatially. 
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5. A system according to Claim 3. characterized in that the system comprises: 

(1) an array of pixel elements, each pixel element providing means for 
generating a pixel signal having a magnitude substantially proportional 
to the intensity of the image at the pixel. 

(ii) means for converting the pixel signals into a loganthmic form, 

(iii) means for digitising the logarithmic pixel signals, and 

(iv) means for filtering the digitised loganthmic signals spatially 

6. A system according to Claim 3, characterized in that the system compnses: 

(i) an array of pixel elements, each pixel element providing means for 
generating a pixel signal having a magnitude substantially proportional 
to the logarithm of the intensity of the image at the pixel, 

(ii) means for digitising the logarithmic pixel signals, and 

(iii) means for filtering the digitised logarithmic pixel signals spatially. 

7. A system according to Claim 3. characterized in that the system compnses: 

(j) an array of pixel elements, each pixel element providing means for 
generating a pixel signal having a magnitude substantially proportional 
to the logarithm of the intensity of the image at the pixeL 

(ii) means for filtenng the loganthmic pixel signals spatially, and 

(iii) means for digitising the filtered logarithmic pixel signals. 



8. 



A system according to Claim 7, characterized in that the means for filtering 
the loganthmic pixel signals spatially comprises an array of circuit elements. 
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each circuit element providing means for receiving a pixel element signal and 
for subtracting a local average signal from the pixel element signal and for 
updating the local average signal in response to any difference between the 
iocat average signal and the pixel element signal. 

9 A system according to any one of Claims 4 to 8, characterized in that the 
system includes means for correcting non-uniformities in pixel element 
performance. 

10. A system according to any preceding claim,' characterized in that the system 
provides means for outputting a digitised filtered image such that each pixel of 
the image is represented by not more than five bits. 

11 A system according to Claim 10, characterized in that each pixel of the image 
is represented by a single bit. 

12. A system according to Claim 1 . characterized in that the system is adapted for 
the surveillance of non-natural scenes and comprises: 

(i) an array of pixel elements, each pixel element providing means for 
generating a pixel signal having a magnitude substantially proportional 
to the intensity of the image at the pixel. 

(ii) means for digitising the pixel signals, and 

(iii) means for filtering the digitised pixel signals spatially. 

13. A system according to Claim 12, characterized in that the system is adapted 
for the sun/eillance of scenes containing a light source. 



14. 



A system according to any preceding claim, characterized that the system is 
incorporated within a surveillance system. 
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15. A system according to Claim 14, characterized in that the surveillance system 
comprises means for generating and storing a spatially filtered representation 
of an image and means displaying the filtered image. 

16. A system according to any one of Claims 1 to 10. characterized in that the 
system is an imaging system for an electronic photographic system 
characterized in that the photographic system comprises means for 
generating and storing a logarithmic spatially filtered representation of an 
image and means for converting the stored representation to a linear 
representation for display. 



wo 97/21304 





PCT/GB95/02808 



1/15 




SUBSTITUTE SHEET (RULE 26) 



wo 97/21304 





PCT/GB95/02808 



in 



512 



55 



52 



7 



/ 



50 



2/ 15 

Fig.2. 



60 

2_ 



r 

54 60 



60 



15 



I I 



62 



-T 

58 



1 



64 



66 



CM 



OUTPUT 



Fig. 3. 



+ 5V 



+ 5V 




202 



212 



100 




SELECT 



SELECT 



SUBSTUUTE SHEET (RULE 26) 



wo 97/21304 



PCT/GB95/02808 



3/15 



Fig. 4a. 



134 



POLY 




132-^\ 



SOURCE /DRAIN 
IMPLANT 



POLY H CONTACT 




SUBSTITUTE SHEET (RULE 26) 



wo 97/21304 





PCT/GB95/02808 



4/15 



Fig. 6. 



CENTRAL COLUMN 
OF FILTER 



Fl LTER 
COLUMN 



I I I I 




SAMPLE 
AND 

HOLD ROW 



p1 p2 



FILTER 
ROW 



284 



FILTER OUTPUT 



SUBSTITUTE SHEET (RULE 26) 



wo 97/21304 





PCT/GB95/02808 



5/15 



Fig.7. 



b3 •Hr^260 



230 




OUTPUT 



256 



2. 



258 




SUBSTITUTE SHEET (RULE 26) 



wo 97/2 1 304 





PCT/GB95/02808 



5/1 



Fig. 8a 




OUTPUT.I 



CF1 



CF2 



IN 



Fig.Sb 



62 •H 



SELECT 



vmigh 

V 



278 



^ 424 




1 



426 



408 



CF1 



276 
396 



0UTPUT_1 



412 



CF2 



SUBSTITUTE SHEET (RULE 2Q) 




SUBSTITUTE SHEET (RULE 26) 



wo 97/21304 





PCT/G B95/02808 



8/15 



Fig. 12. 



550 



L 







1 / 


PHOTO - 

DETECTOR 

ARRAY 




BAR 




DISPLAY 




FILTER 


1 ) 
1 664 








662 



560 



Fig. 13 







718 









1 


1 1 












I 














1 




1 







1 

716 710 



700 



J 



712 



714 



SUBSTITUTE SHEET (RULE 26) 



wo 97/21304 



PCT/GB95/02808 



9/15 



Fig. 14. 



752 



I BIAS 



754 



770 



V|N 



760 



r 



764 



762 



5 



766 



758 



756 



V 



OUT 



750 



758 



Fig. 15. 



I COEFFICIENTS^^ — 



1 



1st 


CONVOLUTION 




2nd 


CONVOLUTION 



SUBTRACTION 
FROM ^IMAGE 



LOGARITH 
PHOTODE" 


MIC 
rECTOR 




\ 

ADC 

i 




NON-UNIFORMITY 

CORRECTION 



J MAGE STORAGE^ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



/ 



SUBSTITUTE SHEET (RULE 26) 



PCT/GB95/02808 

10/15 



Fig.16a 




Fig. 16b. 




SUBSTITUTE SHEET {RULE 26) 



PCT/GB95/02808 



11/15 



Fig. 17a. 




Fig. 17b 




SUBSTITUTE SHEET (RULE 26) 



Fig. 18a. 



1 — 



■T T r r 



12/15 



-I r 



PCT/GB95/02808 



800 



802 



VILLAGE SCENE 
ROAD SCENE 



— A 



-t i_ 



50 



100 



8- 



150 200 250 
BIT DIGITISED INTENSITY 



300 



Fig.18b. 



-1 — T 



-1 r 1 1 f 



804 



I i 



1. 



'I 



— -806 



VILLAGE SCENE 
ROAD SCENE 



I ■ 1 L. 



50 



f ^ A 



150 



100 150 200 250 
8 -BIT DIGITISED INTENSITY 



300 



SUBSTtTUTE SHEET (RULE 26) 



wo 97/21304 



PCT/GIJ9S/02808 



13/15 



Fig. 19a. 




Fig. 19b. 




SUBSTITUTE SHEET (RULE 26) 



wo 97/21304 



14/15 



PCT/CB95/02808 



\ 



Fig.20. 




Fig.21 . 




SUBSTITUTE SHEET (RULE 26) 



wo 97/21304 



15/15 



PCT/G nyS/02S08 




SUBSTITUTE SHEET (RULE 26) 



DMTEl 



TIONAL SEARCH REPORT 




u mal Application Ntj 

PCT/GB 95/02808 



A. CLASSIFtCATION Of- SUBJECT MAITFiR 

IPC 6 HG4N5/335 H04N3/15 



Accordjng to (ntemational P atent Cla^jnTtcaqon <IPQ or to both national clayafication and IPC 
B. FIELDS Sf^ARCnrD 



Minimum documentation searched (classificaQon system lollowed by ciassirication symbols) 

IPC 6 H04N 



Documenuuon searched other than minimum documentation to the extent that such documents arc included in the fields searched 



Electronic data base consiilted dunng the intcmauonal search (name of daU base and, where practtcaJ, search temu used) 



1- " "- "' r 
1 Category * 


Citation of dcxiument, with mdicauon, where appropnatc, ul the relevant passages 


Relevant to claim No. I 


X 


US, A, 4 78G 762 (NAGASAKI TATSUO) 25 


1,4,5 




October 1988 


2,3,6,7 


Y 


see column I, line 62 - column 2, line IG; 




figure 11 


16 


A 


see column 3, line 32 - column 4, line 29; 




figure 1 




X 


US»A,4 719 350 (ALM AKE W) 12 January 1988 


1,5,9, 




12-15 


A 


see column 1, line 41 - column 2, line 63; 


16 




claim 16; figures 1,4 




X 


US, A, 5 153 731 (NAGASAKI TATSUO ET AL) 6 


1 




October 1992 


7,8 


A 


see column 1, line 32 - line 41; figure 1 




-/-- 





Funhcr documents arc hsted in the condnuaaon of box 



Patern family members are hsud m annex. 



* Special calegoncs of aled documents : 

*A* document defining the general slate of the art which is not 
considered to be of particular relevance 

"E" earlier document but published on or after the mtemationai 
fitmg date 

"L" document \vhich may throw doubts on pnonty claimfs) or 
which IS a ted to establish the publication date of another 
aiation or other spcaal reason (as specified) 

*0' dociimcm referring to an oral disclosure, use. exhibmon or 
other means 

'P' document published pnor to the mtemationai fihng date but 



T' later document published aflcr the intcmaHonal filing daU 
or pnonty date and not m conntct with the applicaaon but 
aled to understand the principle or theory underlying the 
invention 

'X* document of particular relevance; the claimed invention 
cannot be considered novel or cannot he considered to 
involve an invennve step when the document is taken alone 

'Y' document of particuiar relevance; the claimed invention 

cannot be considered to involve an invenuve step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person slalled 
m the art. 

'&* document member of the same patent family 



Form PCT ISA'310 Ueciuid iheei) <July 1992) 



1 Date of the actual completion of the intemauonai search 

22 August 1996 


Date of mailing ot the international search report 

3 0, 08. 96 1 


Name and mailing address of the [SA 

Kuropean Patent Office. P.H. 5818 PatenUaan 2 
NL ' 2280 HV Ri)swi}k 
Tel. ( ^ 31-70) 340-2040, Tx. 31 6SI epo nl, 
Fax ( * 31-70) 340-3016 


Authonzcd officer | 

Montanari , M 



page 1 of 2 



INTE 



ONAL SEARCH REPORT 



inal Application No 

PCT/GB 95/02808 



<::.(Continuaoon) DOCUMENTS CONSIDERED TO HE RELEVANT 



Category 



Citaaon ot documeni, wth indicauon, where appropriate, of the relevant pa.«ages 



PROCEEDINGS OF THE lEEE/RSJ INTERNATIONAL 

CONFERENCE ON INTELLIGENT ROBOTS AND 

SYSTEMS, RALEIGH, NC. , JULY 7 - 10, 1992, 

vol. 1, 7 July 1992. INSTITUTE OF 

ELECTRICAL AND ELECTRONICS ENGINEERS, 

pages 367-372, XP000339029 

PARENT F ET AL: "A VLSI IMPLEMENTATION OF 

A LIGHT SENSOR WITH IMBEDDED FOCAL PLANE 

PROCESSING CAPABILITIES" 

see page 367, right-hand column, line 23 - 

line 32 

US, A, 4 973 833 (TAKADA ET AL.) 27 November 
1990 

see column 1, line 12 - line 52 

I EE COLLOQUIUM ON 'INTEGRATED IMAGING 
SENSORS AND PROCESSING', 

5 December 1994, LONDON, UK, 
pages 1-6, XP000575379 

S. COLLINS ET AL. : "A Critical Review of 
analogue image processing" 
cited in the application 



Relevant lo claim No. 



1 



2,3,6,7 



Fofm PCT.MSA.-210 (cnnunuauon of ivcDCd iheei) (July 1992) 



page 2: of 2 



INTERAnONAJ. SEARCH REPORT 

^^ifonnaa on on pattm family members T p 



Patent, documeni 
cited in search report 



Publication 
date 



US-A-4780762 



25-10-88 



onal AppUcaOon No 

PCT/GB 95/G2808 



Palenc family 
member(s) 



JP-B- 
JP-A- 
JP-B- 
JP-A- 
DE-A- 



7046836 
62132479 

7040725 
52155679 

3641186 



Publication 
date 



17-05-95 
15-06-87 

01- 05-95 
10-07-87 

02- 07-87 





12-01-88 


NONE 






US-A-5153731 


06-10-92 


JP-A- 
JP-A- 


3187585 
3187584 


15-08-91 


US-A-4973833 


27-11-90 


JP-A- 
JP-A- 
JP-A- 


2306786 
2159890 
3232275 


20-06-90 
16-10-91 



Form PCT'lSA. 210 <pit«n( (»mily «nnex> (Juty 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 
Ca FADED TEXT OR DRAWING 

'□f BLURRED OR ILLEGIBLE TEXT OR DRAWING 
' □ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



THIS PAGE BLMiKl'K"'* 



